JUMP-DIFFUSION RISK-SENSITIVE ASSET MANAGEMENT II: 
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Abstract. In this article we extend earlier work on the jump-diffusion risk-sensitive asset management problem in a 
factor model [SIAM J. Fin. Math. 2 (2011) 22-54] by allowing jumps in both the factor process and the asset prices, as well 
as stochastic volatility and investment constraints. In this case, the HJB equation is a partial integro-differential equation 
(PIDE). We are able to show that finding a viscosity solution to this PIDE is equivalent to finding a viscosity solution to a 
related PDE, for which classical results give uniqueness. With this in hand, a policy improvement argument and classical 
results on parabolic PDEs show that the HJB PIDE admits a unique smooth solution. The optimal investment strategy is 
given by the feedback control that minimizes the Hamiltonian function appearing in the HJB PIDE. 
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1. Introduction. Risk-sensitive control generalizes classical stochastic control by considering di- 
rectly the optimizing agent's degree of risk aversion. In risk-sensitive control, the decision maker's objec- 
tive is to select a control policy h(t) to maximize the criterion 



(1.1) J(0,/i) :=-ilnE 



,-0Ft(/i) 



where FT{h) is a reward function at a fixed final time T corresponding to a control process h, and the 
exogenous parameter 9 > represents the decision maker's degree of risk aversion. A Taylor expansion 
of J around 6 = gives 

(1.2) J{0, h) = E [Frih)] - ^Var [FT(h)] + 0{e^). 

In optimal investment problems we take Ft = logVr, where Vr is the value of the investment portfolio 
corresponding to an asset allocation strategy h; then (11.21) shows that risk-sensitive control amounts to 
'dynamic Markowitz': we maximize the expected return subject to a constraint on the variance of returns. 
The reader will find a brief survey of previous work in this area in Part I of this paper [S] . 

In [5], as in Bielecki and Pliska [5] and many other papers, the growth rates of the assets are supposed 
to depend on a random factor process Xt , the components of which can be interpreted either as macroe- 
conomic factors or simply as a statistical representation of the uncertainty of asset returns. We modelled 
Xt as a gaussian diffusion, while the asset prices themselves were modelled as affine jump-diffusions. 
Here we present a more general model that includes jumps in the factor process as well as stochastic 
volatility and investment constraints. Including jumps presents more than a mathematical interest. It 
is also important from a practical perspective as this formulation is necessary to model additional as- 
set classes such as credit products. Our solution technique uses a change-of-measure idea introduced 
by Kuroda and Nagai 15 that reduces the risk-sensitive optimization problem to a stochastic control 
problem in the factor process. When, as in [8|, Xt has no jumps, the associated Bellman equation is 
a partial differential equation (PDE) which was shown to admit a unique classical classical {C^''^) solution. 

In the framework of the present paper the transformed problem a la Kuroda-Nagai is a fully nonlinear 
controlled jump-diffusion, and the Bellman equation is a is a partial integro-differential equation (PIDE) 
for which no analytical solution can be expected. In such a situation, viscosity solutions arc generally 
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used to show that the value function is the unique continuous solution of the HJB PIDE; see in particular 
Crandall Ishii and Lions j5j, Barles and Imbert [1 for an overview of viscosity solutions and Fleming 
and Soner ^10;, 0ksendal and Sulem [12] or Touzi 21 for a discussion of their application to stochastic 
control, as well as Davis and Lleo for a viscosity approach to risk-sensitive asset management. In the 
context of optimal control, a limitation of viscosity solutions is that they are weak solutions: they do 
not generally satisfy the smoothness assumption required to obtain a sufficient condition via a classical 
verification theorem. 

Pham [5D], in the context of linear PIDEs, and more recently Davis, Guo and Wu [5], in the context of 
elliptical PIDEs arising from impulse-control problems, suggested a link between viscosity solutions and 
classical solutions. Their argument differs from more abstract results on classical solutions to PIDEs (see 
for example [18]) in that it is directly tailored to the problem at hand. It is therefore of particular interest 
for the type of applied problems related to optimal control. In this article, we build on this approach to 
prove that the risk-sensitive Bellman PIDE admits a unique smooth solution and solves the risk-sensitive 
asset management problem in a jump-diffusion setting. Our situation is nevertheless different from that 
encountered by Pham or Davis, Guo and Wu. The difficulty in their approach stems form the resolu- 
tion of a free boundary problem with one source of nonlinearity: the nonlocal integro-differential term 
associated with the jumps. In contrast, we have no free boundary value problem but three sources of 
nonlinearity: a quadratic growth term, the optimization embedded in the HJB PDE and the non-local 
nonlinear integro-differential term. While we can readily eliminate the first nonlinearity through a change 
of variable, we must tackle the last two simultaneously. 

The article is organised as follows. We introduce the analytical setting in Section[2]before formulating 
the control problem in Section [3] The main result. Theorem 13.81 is stated in Section 13.31 and proved in 
detail in the two subsequent sections: in Sections 2] and [SJ we respectively address the questions of the 
existence of classical solution to the HJB PIDE, and a verification theorem establishing optimality of our 
candidate control. An Appendix gives the proof of Proposition 13.51 establishing Lipschitz continuity of 
the value function. 

2. Analytical Setting. The asset market comprises m risky securities Si, i — 1, . . .m and a money 
market account process 5*0. The growth rates of the assets depend on n factors Xi{t),. . . ,Xn{t) which 
follow the dynamics given in the jump diffusion equation (j2.3p below. 

Let (fi, 7^, P) be the underlying probability space. On this space is defined an R^-valued {Tt)- 
Brownian motion W{t) with components Wk{t), k = 1, . . . , M, and M := m + n. Moreover, let N be 
a (Jt)-Poisson point process on (0,oo) x Z, independent of W{t), where (Z,Bz) is a given Borel space. 
Define 

(2.1) 3 :={C/eSz,E[7V(i,C/)] <ooVt} 

For notational convenience, we fix throughout the paper a set Zq G Bz such that i^(Z\Zo) < oo and 
define, as in [19] 

(2.2) N{dt,dz) 

_ ( N{dt, dz) - N{dt, dz) = N{dt, dz) - v{dz)dt =: N{dt, dz) if z 6 Zq 
^ \ N{dt,dz) if z G Z\Zo 

For t G [0,T] let J't be the cr-field generated by the Brownian motions Wk(s) and Poisson processes 
N{A, s) for k = 1, . . . , M, A € Bz and < s < t, completed with all null sets of J-t- It is well known 
that the filtration {J-t}te[o,T] satisfies the 'usual conditions'. 

2.1. Factor Dynamics. The factor process X{t) G K" is allowed to have a full jump-diffusion 
dynamics, satisfying the SDE 

(2.3) dX{t):^b{t,X{t-))dt + A{t,X{t))dW{t)+ J £_{t,X{t-),z) N{dt,dz), X{0) = xq eR". 
The standing assumptions are as follows. 

Assumption 1. 
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(i) The function b : [0,r] x R" — > M" is bounded and Lipshitz continuous 

(2.4) \b{t,y)-b{s,x)\<Kbi\t-s\ + \y-x\) 

for some constant Kh > 0. 
(ii) the function A : [0,r] x M" — > M"^*^ is bounded and Lipschitz continuous, 

(2.5) \K{t,y)-K{s,x)\<K^{\t-s\ + \y-x\) 

for some constant K\ > 0. 
(Hi) There exists rjA > such that 

(2.6) C'AA'(i,x)C>r?A|Cl' 

for all C e M" 
(iv) There exists > and K'j^ > such that 

(2.7) \bt\ + \b.\<K 

(2.8) |At| + |A,| <if; 

('uj r/ie function : [0,T] x M" x Z — > M is bounded and Lipshitz continuous, i.e. 

(2.9) |^(i,2/,z)-^(s,a;,z)| <ife(|t-s| + |2/-a;|) 

/or some constant > 0. 
(vi) The vector valued function S^{t, X, z) satisfies: 



(2.10) / \^(t,x,z)\iy{dz) < oo, V(t,a;) G [0,T] x 
and for some constant c 

(2.11) / \^{t,x,z)\^iy{dz) <c{l + \x\f. 



The minimal condition on ^ under which the factor equation (|2.3p is well posed is 

|^(f, z)pi/((iz) < oo, 



see Definition II. 4.1 in Ikeda and Watanabe [11 . However, for this paper it is essential to impose the 
stronger condition (j2.10p in order to connect the viscosity solution of the HJB partial integro-differential 
equation (PIDE) to the viscosity solution of a related parabolic PDE. The same condition is imposed in 
Davis-Guo-Wu [G'. Condition (12. lip is needed in Section [5] 

Remark 2.1. Note that (|2.7p and (|2.8p follow respectively from (|2.4p and (|2.5p when b and A are 
differentiable. 

2.2. Asset Market Dynamics. Let 5*0 denote the wealth invested in the money market account 
with dynamics given by the equation: 

(2.12) ^^^ao{t,X{t))dt, So{0) = so 

Jo[t) 

and let Si{t) denote the price at time t of the ith security, with i = 1, . . . ,m. The dynamics of risky 
security i can be expressed as: 



dS^ 



^= [a{t,X{t-))]^dt + y2^^kit,X{t))dWk{t)+ f j,{t,z)Nidt, 



(2.13) 5^(0) = s„ i = l,...,m 

The standing assumptions are as follows. 

Assumption 2. 



dz), 
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(i) the function gq defined as ag : [0, T] x M" — > M is bounded, of class C^'^ ([0, T] x K") and is Lipshitz 
continuous 

(2.14) \ao{t, y) - ao{s, x)\ < Ko (|t ~ s\ + \y - x\) 

for some constant Kq > 0. 
(ii) There exists Kq > such that 

+ \Dao\ < K'q 

(Hi) the function a : [0,r] x R" — > R™ is hounded and Lipshitz continuous, i.e. 

(2.16) \a{t,y) - a{s,x)\ < Ka{\t - s\ + \y ~ x\) 

for some constant Ka > 0. 
(iv) the function E : [0,T] x R" — >G R'"^^^ is hounded and Lipshitz continuous, i.e. 

(2.17) \nt:V)-ns,x)\<K^{\t~.s\ + \y-x\) 

for some constant Ky: > 0. 
(v) There exists 77s > such that 

(2.18) C^^'{t,x)C>Vs\C\^ 

for all C G R™ 
(vi) There exists K'^ > and > such that 

(2.19) \at\ + \a,\<K 

(2.20) |Et| + |S,| </f^ 

(vii) the function 7 : [0,T] x Z — R™ is hounded, continuous and satisfies the growth condition 

(2.21) \j{t,z)-j{s,z)\<K^{\t-s\) 

for some constant Kj > 0. 
(via) The vector valued function ^{t,z) satisfy: 

(2.22) / |7(t, z)\^u{dz) < 00, V(t, x) e [0, T] x R" 

(ix) We also require 

(2.23) |AI]'(t, y) - AE'(s, x)\ < Kay i\t -s\ + \y- x\) 
for some constant K\y: > 

Remark 2.2. Note that (|2.19p and (|2.20p follow respectively from (|2.16p and (|2.17p when b and A 
are differentiahle. 

We need a further assumption relating the jumps in the asset prices and factors. 

Assumption 3. j{t,z)S,'{t,x,z) = V{t,x,z) e [0,T] x R" x S. This assumption imphes that 
there are no simultaneous jumps in the factor process and the asset price process. This imposes some 
restriction, but appears essential in the argument below. 

2.3. Portfolio Dynamics. The function 7 appearing in (|2.13p is assumed to satisfy the following 
conditions. 

Assumption 4. Define 

S := supp(i^) G Bz 
4 



(2.15) 



dao 



dt 



and 

S := supp(i/o7-i) e S(M'") 

where supp(-) denotes the support of the measure, and let ni!li[7r'™j Tz™"^] smallest closed hyper- 

cube containing S. We assume that j(t,z) G K™ satisfies 

- 1 < 7r" < l^it, z) < 71""" < z = 1, . . . , m 

anrf 

7r"<0<7r''", i = l,...,m 

/or i = 1, . . . , m. 

Define the set Jo as 

(2.24) Jo-.^ {heU"' -.-l-h'i; <0 VV' £ s} 

For a given z G S, tiie equation h'j{t, z) — —1 describes a hyperplane in R™. Under Assumption SI Jo 
is a convex subset of R" for all {t, x) e [0, T] x K". 

Let Qt :— a{{S{s), X{s)),0 < s < t) he the sigma-field generated by the security and factor processes 
up to time t. 

Definition 2.3. An -valued control process h{t) is in class T-Lq if the following conditions are 
satisfied: 

(i) h(t) is progressively measurable with respect to {B{[0,t]) (x) Gt}t^Q o,nd is cddlag; 
(a) h{t) G Jo yt a.s. 
We note that under Assumption |31 a control process h{t) satisfying (ii) is bounded. 

By the budget equation, the proportion invested in the money market account is equal to /lo(^) = 
1 — hi{t). This implies that the wealth Vit) of the investor in response to an investment strategy 

h{t) e 7^0 1 follows the dynamics 

(2.25) '^^^^ {ao(t,X{t)))dt + h\t)a{t,X{t))dt + h\t)-i:{t,X{t))dWt+ [ h'{t)j{t, z)N{dt,dz), 

with V^(0) — uq, the initial endowment, and a := a — agl, where 1 G R™ denotes the m-element unit 
column vector. 

2.4. Investment Constraints. We consider r G N fixed investment constraints expressed in the 
form 

(2.26) r'h{t) < V 

where T G R™ x R"" is a matrix and u G R*" is a column vector. For the constrained control problem to 
be sensible, we need T and v to satisfy the following condition: 
Assumption 5. The system 

T'y < V 

for the variable y G R'" admits at least two solutions. 
We define the feasible region J as 

(2.27) J:={heJo: T'h < v} 

The feasible region J' is a a convex subset of R™ and as a result of Assumption [5l J has at least one 
interior point. 
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2.5. Problem formulation. The class A of admissible investment strategies is defined as follows. 
Definition 2.4. A control process h{t) is in class A if the following conditions are satisfied: 
(i) h £1-1, where 

(2.28) H := {h{t) e Ho : h{t) e J yt e [0, T] , a.s.} 

(a) Ex''(T) = 1 where x''(t) is the Doleans exponential defined for t G [0,r] hy 

X^{t) :=exp|-6i^ h{sY^{s, X{s))dWs - ^9^ h{sy^^'{s,X{s))h{s)ds 

+ [ [ \n{l-G{s,z,h{s)))N{ds,dz) 
Jo Jz 

(2.29) 

with 

(2.30) G{t,z,h) {l + h'-j{t,z)y'^ 



Recall that om- objective is to maximise the risk-sensitive criterion J{h, v) of (|l.ip with Ft ~ In V{T). 
From (I2.25P and the general Ito formula we find that the term e"*'"^^^) can be expressed as 



(2.31) 
where 

(2.32) 



git,Xt,hit))dt}x\T) 



g{t, x,h) = -{6 + 1) h'i:i:'it, x)h - ao{t, x) - h'a{t, x) 



il + h'j{t,z)y 



+ h'-/{t,z)lzo{z)}i^idz) 



and the Doleans exponential x'''{T) is given by (I2.29p . 



Remark 2.5. For a given, fixed h, the functional g is bounded and Lipschitz continuous in the state 
variable x. This follows easily by boundedness and Lipschitz continuity of the coefficients oq, a, S and 7. 



For /i e and 6* > let P'' be the measure on (yi^Fr) defined via the Radon-Nikodym derivative 



(2.33) 



X\T), 



and let E'* denote the corresponding expectation. Then from (|2.3ip we see that the criterion J is given 

by 



(2.34) 



1 



J{h) = lni;o - ^InE'' 



exp|0/ g{t,Xuh{t))dVj 



Evidently, the value vo plays no role in the optimization process. Throughout the rest of the paper we 
normalize to wq = 1- Moreover, under P'', 



Wff = Wt+e / Y.{s,X{s))'h{s)ds 
Jo 

is a standard Brownian motion and the P''-compensated Poisson random measure is given by 
N^{ds,dz)^ f I N{ds,dz)- f I {l~G{s,X{s),z,h{s))}v{dz)ds 



^z, 



JZa 

t 



J7.Q 

t 



JZ, 



N{ds,dz)- I J i^{l + h'j{s,X{s),z)) ^^u{dz)ds 



As a result, under P'' the factor process X{s), < s < t satisfies the SDE: 

(2.35) dX{s) = f{s,X{s),h{s))ds + A{s,X{s))dW^+ [ ^ {s,X{s-),z) N''{ds,dz), X{0)=xo 



i{t,x,z) {l + h'-i(t,z)) - lzo{z) v{dz) 



where 

(2.36) /(t, X, h) h{t, x) - eAY.{t, x)'h - 

and b is the P- measure drift of the factor process (see (12.3^ ). 

Remark 2.6. The drift function f is Lipschitz continuous with coefficient Kf — Kh + 0K\Y: +K(^Ko 
where Kq > is a constant. For a constant control h the state process X(t) is a Markov process with 
generator 

£u{t,x) := f{t,x,hyDu+^tr{AA'{t,X)D^u) 

(2.37) + / {u{x + C{t,x,z))~u{x)-^{t,x,zyDu}iy{dz)ds 

Jz 

In summary, we have shown that the risk-sensitive asset allocation problem is equivalent to the stochastic 
control problem of minimizing the cost criterion 











(2.38) 


J{h) ^ e'* 


exp^^y" g{t,Xt,h{t))dt^ 













over the control set A for a controlled process Xt satisfying (in 'weak solution' form) the jump-diffusion 
SDE (j2.35l) . The remainder of the paper is devoted to solving the stochastic control problem (j2.35p . (|2.38p . 

3. Dynamic programming and the value function. We will solve the control problem by study- 
ing the Hamilton- Jacobi-Bellman (HJB) equation of dynamic programming, which involves embedding 
the original problem in a family of problems indexed by time-space points {s,x), the starting time and 
position of the controlled process Xt . The description here is in the same spirit as Bouchard and Touzi 

For fixed s G [0, T] we define the fihration { J^", i e [s, T]} by 

= a{Wkir) ^Wkit),N{A,r) ^ N{A,t),k ^ 1, . . . ,M,A G Bz,s < r <t} 

and note that J^^ is independent of Tt- X{t) will denote the solution of (|2.3p on [s, t] with initial condition 
X{s) — X and Fg.x the measure on such that Ps^a;[Xs = x] = 1. The class of admissible controls A"^ 
is defined analogously to A above with h adapted to J-^, leading to a change of measure on defined 
by the Radon-Nikodym derivative 



■ s.x 



= X1{T). 



We will now introduce the following two auxiliary criterion functions under the measure P^ , 



(3.1) /(s,x,/i)=E^_ 

(3.2) I{s,x,h) = -\h\i{s,x,h). 



Remark 3.1. The criterion I defined in (j3.ip . which is the cost function for our stochastic control 
problem, can be interpreted as a payoff of 1 at the terminal time T 'discounted' at a stochastic controlled 
rate of ~9g{-) (which is however not necessarily > 0). 

The corresponding value functions are 

(3.3) ^{s,x) ^ inf I{s,x,h); $(s,x)= swp I{s,x,h). 

Lemma 3.2. <I>(s,x) = iniheA lis, x, h). That is, the infimum is unchanged if the class A'^ is replaced 
by the larger class A. 

Proof. This uses exactly the argument of Remark 2, page 958 of Bouchard and Touzi We condition 
on the initial filtration and use the independence of Tg and . □ 



exp <^ 6* / g{t,Xt,h{t))dt 
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3.1. The Risk-Sensitive Control Problems under P^. We will show that the value function $ 
defined in Q satisfies the HJB PIDE 



(3.4) ^ + supL'' (t,a;,$,D$,D24>) = 
where J is defined in (I2.27p . 

1 9 

L'^ (t, X, u,p, M) = /(i, X, h)'p + -tr (AA'(t, 2;)Af) - -p'AA'{t, x)p 

(3.5) -g{t,x,h) +lNL[t,x,u,p] 
with 



(3.6) 



and subject to the terminal condition (recall our normalization vq — 1) 

(3.7) $(T,x)=0, xeM". 

Condition (j2.f Op ensures that Inl is well defined, at least for bounded u. 
For $, the corresponding HJB PIDE is 

^'^-{t,x) + itr (AA'(i,a;)i:)^$(t,a;)) + H{t,x,^,D^) 



dt 

(3.8) +y |l>(t,a; + $(i,a;,z)) -$(t,a;) -C(i,a;,^)'-D$(i,a;)|i^(dz) 
subject to terminal condition 

(3.9) $(T,a;) = l 
where for r G R, p G 



iJ(s, x, r,p) = mi^ {/(s, x, h)'p + 6*3(3, x, h)r} 



(3.10) 



Remark 3.3. T/ie Junction H satisfies a Lipschitz condition as well as the linear growth condition 

\H{s,x,r,p)\<C{l + \p\), V(s,a;)eQo 

The value functions $ and $ are related through the strictly monotone continuous transformation 
^{t,x) = exp{—9^{t,x)}. Thus an admissible (optimal) strategy for the exponentially transformed 
problem is also admissible (optimal) for the risk-sensitive problem. In the remainder of the article, we 
will refer to the control problem and HJB PIDE related to the value function $ as the risk sensitive 
control problem and the risk sensitive HJB PIDE, and to the control problem and HJB PIDE related to 
the value function $ as the exponentially transformed control problem and the exponentially transformed 
HJB PIDE. 

3.2. Properties of the Value Function $. We start by establishing two a priori properties of 
the value function. 

Proposition 3.4. There exists M > such that 

0<^{t,x)<M y{t,x) e[0,T]xW. 

Proof. The strategy of investing only in the money-market account, i.e. taking h = is sub-optimal, 
and hence 

^(t,x) < -E^^e^'-I't^ s'-^'^'''^-^^'^' = ^Q^^ej;^aois.Xis)ds ^ ^eao{T-t)^ 

8 



where is a bound for |ao(t,a;)| (see Assumption [2l|i|). 



Moreover, 



inf E,'',, 



exp ■ 



g{s,Xs, h{s))ds 



> 



This follows from Corollary 13.71 below: the concave minimization problem admits a unique minimizer 
which is an interior point of the set J' defined in equation (|2.24p . This concludes the proof. □ 

Proposition 3.5. The value function $ is Lipschitz continuous in the state variable x. 

Proof. See Appendix [21 □ 

Proposition 3.6. Under h2.18\) and Assumption\^ the supremum in p. 41) . (j3.5l) admits a unique 
Borel measurable maximizer h{t,x,p) for {t,x,p) £ [0,1"] x M" x M". 
Proof. The supremum in p.4p can be expressed as 

sup {t, X, u,p, M) 

= sup 1 (b{t, x)+ [ ^{t, X, z) \{1 + h'j{t, z))"^ - Izo {z)] i^{dz)) p - 9h'j:A{t, x)'p 
hdj [ V Jz L J / 

1 Q 
+ -tr (AA'(t, x)'M) ~ -p'Kh'it, x)'p + Xnl [t, x, 



1 



' + 1) h'T.Y,'{t, x)h + ao(i, x) + h'a{t, x) 



+ h'j{t,z)lz„{z)}iy{dz) 



{l + h'j{t,z)y 



b\t,x)p+ -tr {AA'{t,x)M) - -p' KA' {t,x)' p + aa{t,x) +Inl [t,x,u,p] 



■ sup 



(Q + 1) h!Y.Y!{t, x)'h ~ eh'j:A'{t, x)p + h'a{t, x) 



(3.11) -i / {ii-9^it,x,zyp)[ii + h'^it,z)y 



- 1 



6h 



'^{t,z)lz,{z)}^{dz) 



Define the auxiliary functional 



1 



e{h- x,p)^ -{6 + 1) h'Y.Y.'{t, x)h + 9h'Y.A'{t, xYp - h'a(t, x) 



+ ^ / {{i~0^{t,x,zYp)[{l + h'j{t,z)) ' -l\+0h'^{t,z)lz,{z)},y{dz) 



for h e R", X e W\ p G R" and £ (0, oo). Under Assumption ^J^, for any p e M" the terms 



-{e + l)h'j:j:\t,x)h + eh'T.A'{t,x)p-h'a{t,x)+ / h'-i[t,z)lz„{z)v{dz) 
2 Jz 

is strictly convex in h V(t, x, z) e [0, T] x R" x Z a.s. dv. Under Assumption|21 the nonlinear jump-related 
term 

\ f [{l-e£,'{t,x,z)p) [{l + h'^{t,z))-' -l]]v{dz) 



simplifies to 



\ j^{[{l + h'^{t,z))-' -I 
which is also convex in h V(t, a:, z) G [0, T] x R" x Z a.s. dv. 



} v{dz) 



As a function of the variable ft., i{h] x,p) can be defined more precisely as a mapping from the vector 
space R™ into R. Moreover, £ is continuous in h Vh G R™, twice differentiable and with continuous 



derivatives. Finally, / attains its infimum, and the infinium is finite. 



Looking at the constraints, the matrix T defines a mapping from the vector space M™ into the normed 
space generated by associating to the constraint vector space lA the Euclidian norm. Under Assumption[5l 
there exists an hi such that T'h < v. 

As a result, the auxiliary constrained optimization problem 

iam£{h] x,p) 

is a convex programming problem satisfying the assumptions of Lagrange Duality (see for example Theo- 
rem 1 in Section 8.6 in [TB]). We therefore conclude that the supremum is reached for a unique maximizer 
h{t, x,p), which is an interior point of the set J defined in equation (|2.24p . and the supremum, evaluated 
at h{t,x,p) € M", is finite. By measurable selection, h can be taken as a Borel measurable function on 
[0,T] X M" X R". 
□ 

Corollary 3.7. Under h2.18\) and Assumption\^ the infimum in p.lOp admits a unique Borel 
measurable minimizer h{t,x,r,p) for {t,x,r,p) G [0,T] x R" x R x R". 

3.3. Main result. We now come to the main result of this paper. 
Theorem 3.8. Under Assumptions[^{Si the following hold: 

1. The exponentially transformed value function $ defined at p.3p is the unique C^'^ ([0,r] x R") solu- 
tion of the RS HJB PIDE (l^ - f^ . 

2. The value function $, also defined at p.3p . is the unique C^'^ ([0,7"] x R") solution of the RS HJB 
PIDE (13:4)) - (137)) . 

3. The asset allocation h*(t) = h{t, Xt, D^(t, Xt)), where h is the function introduced in Provosition \3.b\ 
is optimal in the class A of admissible controls. 

The detailed argument for the proof of this theorem is given in the next two sections of the paper. 
Section m establishes the existence of a unique C^'^ solution to the HJB equation. Section [S] shows that 
the function h of Proposition 13.61 provides an investment strategy that is both admissible and optimal. 
Combining the results of these two sections, we have the following proof. 

Proof. [Proof of Theorem 13.8] 

Existence of a classical (C^'"^) solution - by Theorem 14.211 the functions $ and $ are, respectively, 
the unique Ci'2([0,T] x R") solutions of the HJB PIDE (I3J|)-(I33|) and HJB PIDE ()3:4| -(l3J | . 

Existence of an optimal control - by Proposition 13. 6[ the supremum in p.4p and infimum in p. 81) 
admit the same unique Borel measurable maximizer/minimizer h*{t, Xt). By ProDOsition l5.3l the control 
h* defined by /i*(i, A'(t)) is admissible, i.e. belongs to the class A. Theorem 15.51 shows by a martingale 
argument that this control is optimal. □ 

4. Existence of a Classical {C^'^) Solution. The objective of this section is to prove that the 
value functions $ and $ are smooth. The process involves 6 steps, which we give in outline here and in 
detail in the six succeeding sections, §§4.1-4.6. 

Step 1: ^ is a Lipschitz Continuous Viscosity Solution (VS-PIDE) of p.8p . Theorem 14.41 below asserts 
that $ is a (possibly discontinuous) viscosity solution of the PIDE p.8p . However, we know a priori from 
Proposition 13.51 that $ is Lipschitz. 

Step 2: From PIDE to PDE. At this point we invoke Assumption l(vi) (I2.10p . which implies that we can 
write the non-local term in p.8p as 

/ {^{t,x + ^{t,x,z)) - ^{t,x)}i^{dz) + / ^'{t,x,z)i^{dz)D^{t,x). 
Jz Jz 

Change notation and rewrite the HJB PIDE as a parabolic PDE a la Pham j20j: 

(4.1) -^{t,x) + -tr {A A' {t,x)D'^u) + Hait,x,u,Du) + d^{t,x) =0 
subject to terminal condition u(T, x) = 1 and with 

(4.2) IIa{s, X, r,p) = inf {/q(s, x, h)'p + 0g{s, x, h)r} 
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for r G R, p g M" and where 



(4.3) 

and 
(4.4) 



fa{s,x,h) := f{s,x,h) - / ^{s, x, z)iy{dz) 

Jz 

= b{s,x) -dA^{s,xYh+ / ^is,x,z) \{l + h'j{s,z)y^ - Izoiz) -l] iy{dz), 



t{t,x)= j [^{t,x + i(t,x,z))-^{t,x)]y{dz). 



Step 3: Viscosity Solution to PDE (|4.ip . We consider viscosity solutions u of the semi-hnear PDE (j4.ip 
(always interpreted as an equation for 'unknown' u with the last term prespecified, with $ defined as 
in Step 1.) The key point is that $ is a viscosity solution of the PDE (j4.1l) . Indeed, due to definition 
(|4.4p , PIDE p.Sp and PDE (14.11) are in essence the same equation. Hence, if $ satisfies the PIDE in the 
viscosity sense, which from Step 1 we know that it does, then m = $ is a viscosity solution of the PDE 
(|4.ip . Note that this last statement depends crucially on the Definition 14 . 11 1 of 'viscosity solution' for the 
PIDE (i.e. no replacement of the solution by a test function in the non-local term.) 

Step 4-' Uniqueness of the Viscosity Solution to the PDE (|4.ip . If a function u solves the PDE (j4.ip it 
does not mean that u also solves the PIDE p. 81) because the term da in the PDE p.Sp depends on $ 
regardless of the choice of u. Thus, if we were to show the existence of a classical solution u to PDE (|4.ip . 
we would not be sure that this solution is the value function $ unless we can show that PDE (|4.1D admits 
a unique solution. This only requires applying a "classical" comparison result for viscosity solutions (see 
Theorem 8.2 in Crandall, Ishii and Lions [5 ) provided appropriate conditions on fa and d* are satisfied. 

Step 5: Existence of a Classical Solution to the HJB PDE (|3.8p . We use an argument similar to that 
of Fleming and Rishel [S] (Appendix E) together with a result from Davis, Guo and Wu [5] to show the 
existence of a classical solution to the PDE (j4.ip with da{t,x) regarded as an autonomous term. 
Step 6: Existence of a Classical Solution to the HJB PIDE (jS.Sp . Combining Steps 4 and 5, we conclude 
that $ and $ are respectively a classical (C^'^) solution of (|3.8p and a classical (C^'^) solution of (|3.4p . 

4.1. <i> is a Lipschitz Continuous Viscosity Solution of 

4.1.1. 

the form 



Preliminary Definitions. The theory of viscosity solutions applies to elliptical PIDEs of 



F(t, x, u, Du, D^u, X[t, x,u]) — 
where I[t, x, u] is the nonlocal operator, and parabolic PIDEs of the form 

du 



dt 



+ F{t, X, u, Du, D u, I[t, x,u]) — 



for a "proper" functional F{t,x,r,p,A,l). 

Definition 4.1. A functional F(t,x,r,p, A,l) is said to be proper if it satisfies the following two 
properties: 

• (degenerate) ellipticity: 



F{t,x,r,p,A,li) < F{t,x,r,p,B,l2), 



B<A,h<l2 



and 

monotonicity 



F{t,x,r,p,A,l) < F{t,x,s,p,A,l), r < s 



We now give a definitions of viscosity solutions based on the notion of test function adapted from 
Barles and Imbert (see Definition 1 in [J): 

Definition 4.2 (Viscosity Solution (Test Functions)). A bounded function u e USC{[0,T] x R") 
is a viscosity subsolution of (j4.7p . if for any bounded test function ip 6 C^''^{[0,T] x R"), if {x,t) is a 
global maximum point ofu — ip, then 



(4.5) 



^ - F {t,x,u{t,x),D^bit,x),D^^P{t,x),I[t,x,4']) < 
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A bounded function u S LS'C([0,r] x M") is a viscosity supersolution of (j4.7p . if for any bounded 
test function ip G C^^^([0,r] x M"), i/ (a;,t) is a global minimum point of u — ip, then 



(4.6) 



^ - F {t,x,u{i.x),D^{t,x),D^i;{t,x),I[t,x,i>]) > 



A bounded function u whose upper semicontinuous and lower semicontinuous envelopes are a viscosity 
subsolution and a viscosity supersolution of p.4p is a viscosity solution of p.4[) . 

An equivalent definition of viscosity solutions based on the notion of semijets (see Definition 4 and 
Proposition 1 in Barles and Imbert [1]) is crucial to extend Ishii's lemma to account for non-local opera- 
tors, obtain a stability result and also show uniqueness of the viscosity solution. In Section 14.51 we will 
consider a third equivalent definition which will enable us to rewrite the PIDE (|3.8p as a 'parabolic' PDE. 



4.1.2. Characterization of the Value Function as a Viscosity Solution. With regards to our 
problem, we can express the HJB PIDE (13. 8|) associated with the exponentially transformed problem i 
as 



(4.7) 



5$ 
'dt 



{t,x) + Fy{t,x,^,D^,D^^,I[t,x,^]) = 



subject to terminal condition (|3.9I) . where 

Fy{t,x,^,D^,D^^,I[t,x,^]) := H^{t,x,^,D^) - ^tr (^AA'{t,x)D^^t,x] 



I[t,x,^] 



(4.8) I[t,x,^]:= J ^^{t,x + £_{t,x,z))-^{t,x)-^{t,x,zyD^{t,x)lzo]'^{dz) 



H^{s,x,r,p) := -H{s,x,r,p) 



sup {-/u(s, X, h)'p - eg{s, X, h)r} 

heA 



for r eM., p E M", and where 

fy{t,x,h) f{t,x,h) - 



£,{t, X, z)iy{dz) 



(4.9) 

with / defined in ((^351) . 



b(t,x)-eAJ:{t,xyh{s)+ / iit,x,z) {l + h'j{t,z)) 



v{dz) 



Under Assumption [T] (pU)) . the functional F satisfies the ellipticity property. Although F is not 
generally monotone, g{s,x,h) is bounded in x (see Remark 12. 5p . In this case, a standard discounting 
technique can be used to circumvent the absence of monotonicity (see for example Proposition II. 9.1 
in [TD] for the general idea and the proof of Theorem 14.141 below for an application in our case) . 

Lemma 4.3. The functional is Lipschitz continuous in t and x 



(4.10) 



\f.{t,y)~ f,{s,x)\<Cf{\t-s\ + \y-x\) 



for some constant Cf > 0. 

Proof. By Assumption [1] ([i]) and Assumption El (lix| b{t,x) and AI](i,x)' are Lipschitz continuous in 
t and x. Moreover, by Assumption [31 



(4.11) 



^it,x,z) {l + h'"f{t,z)) -1 j/(dz) = 



and the result follows. □ 

Theorem 4.4. $ is a Lipschitz continuous viscosity solution of the RS HJB PIDE p.8p on [0,T] x 
M", subject to terminal condition (|3.9p . 

Proof. We first show that $ is both a, possibly discontinuous, viscosity subsolution and viscosity 
supersolution. 
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step 1: Viscosity Subsolution. Let {to,xo) e Q := [0,<] x M" and u G C^-^{Q) satisfy 



(4.12) 



= ($* - u){to,XQ) = max - u{t,x)) 

{x,t)eQ 



and hence, on Q, 
(4.13) 

Let (tk, Xk) be a sequence in Q such that 



lim {tk,Xk) = (<o,a^o) 



lim $(tfe,a;fc) = l>*(to,a;o) 



/c— voo 



and define the sequence {"0}^ as V'fc '■— ^itk,Xk) — u(tk, Xk)- Since u is of class C^'^, linifc_s.oo "iAfc 0. 

Fix h € J and consider a constant control h = h. Denote by the state process with initial data 
X^^ = Xk and, for fc > 0, define the stopping time 

Tk inf {s > tfc : (s - tk,X^ - Xk) i [0,4) x a^„} 
for a given constant a > and where ^„ is the unit ball in M" and 

4 := - -'{o}('0fc)) + fc"^i{o}(V'fe) 

From the definition of r^, we see that limfc_).oo Tk — tg. 

The value function $ satisfies the Dynamic Programming Principle, by Theorem 3.5 of Bouchard 
and Touzi so that 



(4.14) 



^{tk,xk) < Et,„ 



exp ^ / gis,X,,h,)ds\^Tk,X!;J 



where 'Eit^^x^ [•] represents the expectation under the measure P given initial data (tk,Xk)- See Remark 
for further clarification of this point. 



By inequality (|4?T3)) . 

^{tk,Xk) < Et,,x, 

and hence by definition of ipk, 

u{tk,Xk) +il^k < 'E^tk.x 



exp<^e I g{s,Xs,hs)ds}u{Tk,X;J 



exp<{6l/ gis,Xs,hs)ds}u{Tk,X!^J 
tk 



I.e. 



Define Z{tk) ^ 9 J^" g{s,X,, h,)ds, then 



exple g{s,Xs,hs)ds}uiTk,X'^) 



u(tk,Xk) 



die^") := eg{s,Xs,hs)e^'ds 



Also, by Ito, 



dus = l^^+Cu^ds + Du'A{s)dWs 



+ / {u{s,X{s') + ^{s,X{s-),z)) -u{s,X{s-))} Np{ds,dz) 
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for s £ [ifejTfe] and where £ is the generator of X{t) given in (|2.37p . 

By the Ito product rule, and since dZg ■ Ug — 0, we get 

d (u^e'^^) — Usd (e^°) + e^'dug 

and hence for t G [tfc, t^] 



tk 



J' (^^(s, X^) + Cu{s, X^)e^^^ ds + J^' Du' 



A{s)dW, 



+ / {u{s,X\s-)+i{s,X''{s-),z)) ~u{s,X''{s-))}Np{dt,dz) 

Noting that u{tk,Xk)e^*'< = u{tk,Xk) and taking the expectation with respect to the initial data 
{tk,Xk), we get 



'^{s, Xs) + Cuis, Xs) + 6u{s, Xs)9is, X„ h,) ) e^'ds 



ds 



In particular, for t — Tk, 



ipk < ^tk,xk [ui-rk^XrJe^^"] -u(<fc,a;fe)e^''= 



E 



tk 



3vb 

— {s,Xs) + Cu{s,Xs)+eu{s,Xs)9(s,Xs,hs) ] e^^ds 



and thus 



Sk Sk 



< T- {'E,tk,xk, [w(Tfc,^Tje^-fc] -u(tk,Xk)e 



Sk ' 



' ^ ^{s,X,) + Cu{s,Xs) + 9u{s,Xs)g{s,X,,K) ] e^'ds 



tk 



ds 



As fc -> oo, tk to, Tk ^ to, ^ and 



Sk 
du , 



E 



tk,Xk 



S, 



tk 



ds 



{s,X,) + Cu{s,Xs) + eu{s,Xs)gis,X„h,) e^^ds 



^ — (s, Xs) + Cu{s, X,) + eu{s, Xs)g{s, X„hs) 
ds 

a.s. by the Bounded Convergence Theorem, since the random variable 



1 



du 



5k Jtk \ 9s 
is bounded for large enough k 



(s, Xs) + Cu{s, Xs) + 9u{s, Xs)gis, Xs, hs) e^^ds 



Hence, we conclude that since hs is arbitrary, 
du 



I.e. 



ds 

du 

ds 



(s, Xs) + Cu{s, Xs) + eu{s, Xs)g{s, Xs, hs) > 



(s, Xs) - Cuis, Xs) - 0u{s, Xs)g{s, Xs, hs) < 



This argument proves that F is a (discontinuous) viscosity subsolution of the PDE p.8p on [0,t)x] 
subject to terminal condition l>(T, a;) = e*^^*^^'"^^. 
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step 2: Viscosity Supersolution 

This step in the proof is a shght adaptation of the proof for classical control problems in Touzi 
Let (tQjXo) e Q and u G C^'^{Q) satisfy 

(4.15) (<i>* - u)(to,XQ) < - u){t,x) for Q\{to,xo) 
We intend to prove that at (to^xo) 

^{t,x) + inf {C''u{t,x)-eg{t,x,h)] < 

(Ji h^'hL 

by contradiction. Thus, assume that 

(4.16) ^it,x)+ inf {C''u{t,x) ~eg{t,x,h)} > 
at {to.xa). 

Since C^u is continuous, there exists an open neighbourhood Ms of (to, xq) defined for (5 > as 

(4.17) Ms ■■={{t,x) : {t-to,x~xo) G {-S,S) x S^n, and (jil^ holds} 

Note that by (|4.15|) and since l> > > u, 

min I $ — u ) > 

For p > 0, consider the set of p-optimal controls satisfying 

(4.18) iito,xo,hP) <^{tQ,xo) + p 



Also, let e > 0, e < 7 be such that 

(4.19) min f $ - u") > 3ee~''^*^'' > 

QWs V / 



where Ms is defined as 



Ms:— max {~g{x,h),0) 



for 

(4.20) Mi := {(t, x):{t- to, x - xa) e (-<5, 6) x {( + S).^n} 

and 

C := max||^(z)|| 

Note that Ms < oo by boundedness of g (see Property [23]). 
Now let {tk, a;*;) be a sequence in Afs such that 



and 



lim {tk,Xk) = {to,xo) 

k—>oo 



lim <^>{tk,Xk) = $*(to,a;o) 

k^oo 
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Since ($ — u){tk,Xk) — > 0, we can assume that the sequence {tk,Xk) satisfies 

(4.21) \{^-u){tk,Xk)\<e, forfc>l 
for e defined by 

Consider the e-optimal control /i^ , denote by the controlled process defined by the control process 
/i| and introduce the stopping time 

Tk :=inf{s>Tfc : (s, Xl{s)) Ms} 

Note that since we assumed that — cxd < ™ < £,i < S,"^^^ < oo for i = 1, . . . , n and since ly is assumed to 
be bounded then X{t) is also finite and in particular, 

(4.22) (l>-w)(Tfe,l^(Tfc)) > i^,-u)iTk,XliTk))>3ee-^'^'' 



Choose TV/ so that {t,X'^{t)) G TV/. In particular, since X'^{t) is finite then TV/ can be defined to 
be a strict subset of Q and we can effectively use the local boundedness of g to establish Ms- 

Let Z{tk) = e Q g{s,Xl,hl)ds, since $ > and by (IT^ and g^S^]), 

$(Tfe,l^(Tfc))e^(^'=) -$(tfe,Xfe)e^(*'=) 
> 7.(Tfe,l^,(rfc))e^(^^) -$(tfc,Xfe)e^(*'=) +3ee-^^*^^e^(^'=) -e 

> 



d[u{s,Xl{s))e^^\+2e 



I.e. 



Htk.Xk) < l>(rfc,l^.(rfc))e^(^^) - / d (m(s, l^(s))e^=) 



2e 



Taking expectation with respect to the initial data {tk, Xk), 



|.(rfc,X^(rfc))e^(-'=)- / d L(s, l^(s))e^=) 



Note that by the Ito product rule, 



d(u{.s,X'k{s))e- 



du 
'di 



{t,x) + C''u{t,x) +eg{t,x,h) 



Since we assumed that 



then 



and therefore 



du 
'di 



{t, x) - C''u{t, x) - 0g{t, x,h) <0 



d{uis,Xlis))e'' <0 



$(Tfe,X^(Tfe))e 



■{ui.s,Xlis))e 



< -2e + E 

< -2e + i{tk,xk,hl) 

< ^{tk,Xk) - e 



exple giXs,hlis))ds\^Tk,XUTk)) 



2e 



2e 
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where the third inequahty follows from the Dynamic Programming Principle and the last inequality fol- 
lows from the definition of e-optimal controltHI- 



Hence, equation (|4.16p . 



^it,x) + inf {C''uit,x) ~0g{t,x,h)} > 



is false and we have shown that 

^it,x) + inf {C''uit,x) ~eg{t,x,h)} < 



This argument therefore proves that $ is a (discontinuous) viscosity supersolution of the PDE 
on [0,t) X R" subject to terminal condition ^{T,x) = e'^3Tix;T)^ 

Step 3: Viscosity Solution. Since $ is both a (discontinuous) viscosity subsolution and a supersolu- 
tion of p.8p . it is a (discontinuous) viscosity solution. But we already know from Proposition [33] that l> 
is Lipschitz continuous. □ 



Remark 4.5. Theorem 3.5 of Bouchard and Touzi ^S] provides the Dynamic Programming Principle 
(DPP) (|4.14p we needed above to show the existence of a viscosity solution. They state it in 'weak' form, 
meaning that on the right-hand side the value function is replaced by its upper semi- continuous envelope. 
However, in our case we knoiu a priori that the value function is continuous, so it is valid to state the 
DPP in its classic form as in (|4.14p . We can check that Conditions A1-A4 of the theorem are valid in 
our 'weak solutions' formulation of the control problem. 

In Section 5 of 13], Bouchard and Touzi directly address the DPP question and characterization of 
optimality by viscosity solutions of the HJB equation for a class of controlled Markov jump- diffusions. 
We cannot use their results (Proposition 5.4 and Corollary 5.6) directly as the formulation is subtly dif- 
ferent and the conditions exclude infinite-activity jumps, although the core of their argument does not 
depend on the nature of the jumps. As .stated in Remark 5.1 of ]3l their assumption is necessary to 
match the strictest set of assumptions required by Barles and Imbert [Ijj. It is widely appreciated that the 
heart of viscosity solution theory lies in the uniqueness theorems and, as seen for example in Barles and 
Imbert 11], to prove the necessary comparison theorems stronger conditions are generally required than 
those needed for existence. Our strategy is to by-pass this question entirely by taking a route that only 
requires uniqueness of viscosity solutions for PDEs — where a large literature exists — rather than PIDEs 
where results are sparser. 



Corollary 4.6. $ is a continuous viscosity solution of the RS HJB PIDE p.4p on [0, T] x M", 
subject to terminal condition p.7p . 

Proof. This follows from the change of variable property (see for example Proposition 2.2 in Touzi |21) ) 
which applies here because (a) the value function $ is bounded by Proposition 13.41 and (b) the function 
ip{x) = e-^^ is of class Ci(R) and < 0. D 

4.2. Prom PIDE to PDE. We define the functional fa, the non-local function I and the functional 
da respectively as: 



fa{x,h) ■.^f{x,h)- I ^{t,x,z)iy{dz) 
Jz 

= b{t,x)-eKi:{t,x)'h{s)+ I ^it,x,z) {l + h'-f{t,z)y 



(z)-l 



v{dz) 



(4.23) 

where / is defined in (|2.36p . 

(4.24) dl{t,x) ^i\t,x,^{t,x) 



1$ (t, a; + i{t,x, z)) - $(i,x)| v{dz) 



^For e > 0, the set J" of e-optimal controls h'- is the set of control satisfying 

i(to,XQ, h^) < l>(to,a;o) + e 
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z 



Zn 



Remark 4.7. Under Assumption\^ 

(4.25) / ^{t, X, z) \{l + h'jit, z)y" - Izo (z) - 1 J^{dz) = - / ^{t, x, z)v{dz) 
and therefore 

(4.26) fa{x,h)^b{t,x)-eA^{t,xyh{s)- I £^{t,x, z)v{dz) 

Zn 



Under Assumption (|2.10p . fa is well defined. With this notation, we can express the risk-sensitive 
integro-differential HJB PIDE in terms of an equivalent parabolic PDE (j4.ip as stated in Step 2 of our 
outline proof above. 

The functions fa and X have the following properties: 

Lemma 4.8. The function fa is Lipschitz continuous and bounded. 

Proof. This follows from the continuity and boundedness of fa and from the boundedness of 
J^^^{t,x, z)i'{dz), using Assumptions l(v) and l(vi). □ 



Lemma 4.9. The function X 



t,x,^{t,x) 



is continuous. 

Proof. The proof of continuity follows along the lines of Lemma 3.2 in Davis, Guo and Wu [5], and 
relies on the Lipschitz continuity of $ (Proposition [23]) and on Assumption l(vi). 
□ 



4.3. Viscosity Solution to the PDE (j4.ip . Using the notation introduced in the previous step, 
we can express the risk-sensitive integro-differential HJB PDE as: 

(4.27) ^it,x) + -tr (AA'{t,x)D^^{t,x)) + Ha{t,x,^, D^) +m{t,x) = 



subject to terminal condition ^{T,x) = 1 



Remark 4.10. By Remark \3.3[ the function Ha satisfies a Lipschitz condition as well as the linear 
growth condition 

\Ha{s,x,r,p)\ <Ca{l + \p\), V(s,a;) G Qo 



We now present an alternative definition first suggested by Pham [20 and then formalized in the 
context of impulse control by Davis, Guo and Wu 6^. In this definition, the integro-differential operator 
is evaluated using the actual solution. 

Definition 4.11 (Viscosity Solution (Test Functions in the Local Terms Only)). A bounded function 
u e USC{[0, T] X M") is a viscosity subsolution of (|4.7p . if for any bounded test function -0 S C^''^{[0, T] x 
R"), if {x,t) is a global maximum point ofu — ip, then 

dih 1 

(4.28) ~ ~it ~ -tr{AA'{t,x)D'^ij{t,x)) - Ha{t,x,u{t,x),Di;{t,x)) -iu{t,x) < 

A bounded function u £ LS'C([0,r] x M") is a viscosity supersolution of (j4.7p . if for any bounded 
test function ip G C"'^'^([0, T] x R"), if (x, t) is a global minimum point of u ~ ip, then 

dih 1 

(4.29) ~ ~it~ 2^^(^^'(*'^)^^^(*'^)) ~ Ha{t,x,u{t,x),D'ip{t,x)) -Xu{t,x) > 

A bounded function u whose upper semicontinuous and lower semicontinuous envelopes are a viscosity 
subsolution and a viscosity supersolution of (13.41) is a viscosity solution of p.4p . 

Proposition 4.12. The definitions of viscosity solutions \4.<^ and \4.11\ are equivalent. 
Proof. The argument follows from Davis, Guo and Wu [5]. □ 
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Definition 14.111 and Proposition 14.121 enable us to relate the viscosity solutions of HJB PIDE (j3.8|) 
and HJB PDE g3]). 



Proposition 4.13. The function ^ is a viscosity solution of (|4.1|) . 

Proof. The proposition is a direct consequence of Definition 14.111 and Proposition 14.121 □ 
We now need to establish uniqueness for the PDE (|4.ip . 

4.4. Uniqueness of the Viscosity Solution to the PDE (|4.ip . The argument here follows the 
conventional steps of the 'Users' Guide' 

Theorem 4.14 (Comparison Result for the Parabohc PDE). Under Assumption (|2.10p . if u is a 
bounded use subsolution of (|4.ip subject to terminal condition (j3.9p and v is a bounded Isc subsolution 
of (j4.ip subject to terminal condition p.9p . then u < v on [0,T] x M". 

Proof Let u G USC{[0,T] x M") be a viscosity subsolution of ^1]) and t; e LSC{[0,T] x R") 
be a viscosity supersolution of (|4.7p . As is usual in the derivation of comparison results, we argue by 
contradiction and assume that 



(4.30) sup [u{t, x) - v{t, x)] > 

[0,T]xR" 

Define go as 

(4.31) go = 9 inf {-g(t, x, h)} V 

Because g is strictly convex in h and it bounded in {t, x) for a given h ^ lA, go is well defined and in 
particular Q < go < oo. Let 

u{t,x) e"f«*u(t,a;) 
w(i,x) := e~^''*t;(i,x). 

Then u g C/5'C([0,r] x R") and v G LS'C([0,T] x R") are respectively a viscosity subsolution and a 
viscosity supersolution of the HJB PIDE then (p satisfies the HJB PIDE 

(4.32) - ^{t, x) + Fb(t, X, 0, Dcp, D^cp) = 
subject to terminal condition (j3.9p . where the functional F is defined as 

^h(t, X, (j>, Del), D^4)) = Hb{t, X, (j), D<t)) - itr (AA'(t, x)D^(t){t, x)) 

and where is defined as 

Hbis,x,r,p) ^ gor + sup {-fv{s,x,hYp - Og{s,x,h)r} 

for r e R, p e R". Observe that 

Hb{s,x,r + d,p) - Hb{s,x,r,p) > god 

for any r > and therefore 

(4.33) Fb{s,x,r + d,p) - Fb{s,x,r,p) > god. 
The contradiction (|4.30p is equivalent to: 

(4.34) sup [uit, x) - v{t, x)] > 

[0,T]xR" 

Now, we can apply Theorem 8.2 in Crandall, Ishii and Lions [5^ with Lemma 14.151 below providing the 
modulus of continuity. 
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Lemma 4.15 (Modulus of Continuity). There exists a continuous function ui : 
a;(0) — and such that 



satisfying 



Fb [ t,y,v{t,x), -{x -y),B] ~ Fb[ t,x,v{t,x), -{x ~ y),A 



<uj[-\x- + \x - y\ 



for e > 0, t e [0, T] and x,y d R" and where A, B are symmetric matrices. 

Proof. This proof follows closely the argument given in Lemma V.7.1 in Fleming and Soner[l0] 



We have 



Fb ( t,y,v{t,y), -{x -y),B\ -Fb[ t,x,v{t,y), -{x - y),A 



1 



Hb t,y,v{t,y), -{x - y) ] - Hb [ t,x,v{t,y), -{x - y) 



1 



< sup <^ - \fa{t,x,h) - fait,y,h)\\y - x\ 
+ sup {e\[g{t,x,h) + g{t,y,h)]v{t,y)\} 

+ sup I ifr (AA'(t, X, h)A - AA'{t, y, h)B) 



fait,x,h) - fa{t,y,h)\\y - x\ +9\[g{t,x,h) - g{t,y,h)]v{t,y)\ 



heA 

For a fixed control h, we have by Lemma l4. 8 

1 

e 

<Cf-Jy~x\^+eCg\y~x\v{t,y) 

<Cf^\y~x\^ + CQ\y~x\ 

<Ci (^-Jy - x\^ + \y - x\ 

where Cq = 9CgSup(^s,y)e(o,T)>cK.^v{s,y) and Ci = C/ V Cg. 

Applying Theorem 8.3 in Crandall, Ishii and Lions [5 for a fixed control h, 
tr (AA'(t, X, h)A - kk'it, y, h)B) 

= tr 



KK'{t,x,h) A{t,x,h)A'{t,y,h) 
Ait,y,h)A'{t,x,h) AA' {t,y,h) 

AA'{t,x,h) A{t,x,h)A'{t,y,h) 
A{t,y,h)A'{t,x,h) AA'{t,y,h) 



A 

-B 



I -I 
-I I 



1 

< -tr 
e 

< -tr {AA'{t, X, h) - A{t, x, h)A'{t, y, h) ~ A{t, y, h)A'{t, x, h) + AA'{t, y, h)) 
e 

< itr (|A(i, X, h) - A'(i, y, h)\\A{t, x, h) - A'{t, y, h)\) 
e 

1 



< -tT{\\A{t,x,h)-A'it,y,h)\\^) 



(4.35) 



< — \x - y\ 
e 



where the last line follows from Assumption [T] ([u]) and from the boundedness of A, with 



Thus, 
(4.36) 



Ba:=2 sup \A'^{t,x)\ 

(t,x)e(0,T)xR" 



Fb{t,y,v{t,y),q,B) - Fb{t,x,v{t,y),p,A) < u [ --\y - x\ + \y - x\ 
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where uj{z) = CujZ with C^^ :— Ci + Ca- D 
Corollary 4.16 (Uniqueness) . The value function $ is the unique viscosity solution of the parabolic 

PDE (|4.ip subject to terminal condition p.9p . 

Proof. Uniqueness of the viscosity solution follows from Theorem 14.141 As we noted that $ is a 

viscosity solution of the parabolic PDE (|4.ip . it is therefore the unique solution to the boundary value 

problem. □ 

4.5. Existence of a Classical Solution to the HJB PDE (|4.ip . Now that we have been able 
to rewrite the HJB PIDE as a parabolic PDE, we have access to the literature addressing the existence 
of a strong solution to the HJB PDE, such as Fleming and Rishel [9] or Krylov [12] and [13] • The crucial 
point in this argument is that this new PDE has a unique viscosity solution which also solves the initial 
PIDE. From there, we only need to prove existence of a classical solution to the PDE in order to show 
that the value functions $ is also of class C^'^((0,r) x M"). 

The following ideas and notations are related to the treatment found in Ladyzenskaja, Solonnikov 
and Uralceva 14 of linear parabolic partial differential equations. The relevant results are summarized 
in Appendix E of Fleming and Rishel [S] . They concern PDEs of the form 

(4.37) + -tr (a(t, x)D'^i}) + b'{t, x)Di; + 9c{t, x)iij + d{t, x) = Q 

on a set Q = (0, T) x G and with boundary condition 

il}{t,x) = ^t{x) X e G 

ipit, x) = *(t, x) {t, x) e (0, T) X dG 

The set G is open and is such that dG is a compact manifold of class C^. Denote by 

• d*Q the boundary of Q, i.e. 

d*Q ({T} X G) U ((0,r) x dG) 

• LP{K) the space of p-th power integrable functions on K C Q; 

• ||-||p_/f the norm in LP(i4r). 

Also, denote by Jif^{Q), 1 < p < oo the space of all functions tp such that for tp(t, x) and all its generalized 

partial derivatives g^^. , i,j = 1, . . . , n are in U'{K). We associate with this space the Sobolev- 

type norm: 



dt 



dip 



9V 



P,K II dXiXj 



i=l i,i = l 

We will introduce additional notation and concepts as required in the proofs. 



Recall from the outline of Section 4 that (14. ip is treated as a PDE with an autonomous term d*. 

Theorem 4.17 (Existence of a Classical Solution to the HJB PDE (|4.ip ). Under Assumvtion \2.1(A 
the RS HJB PDE (j4.ip with terminal condition u(T,x) = 1 has a solution u G C^'^ ((0,T) x M") with u 
continuous in [0,r] x R". 

Proof. The proof follows closely the argument of Fleming and Rishel [5] (Theorem VI. 6. 2 and Ap- 
pendix E). 

Step 1: Approximation in policy space - bounded space domain 

Consider the following auxihary problem: fix i? > and let = {a; G R" : < R}. The HJB PDE 
for this auxiliary problem can be expressed as 

du 1 

+ -tr (AA'(t, x)D'^u) + Ha{t, x, u, Du) + d'^{t, x) = 
(4.39) V(t,x) e Qfl := (0,r) X 

where 

Ha{s,x,r,q) = ini^{fa{t,x,h)'q + eg{t,x,h)r} 
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for p G R" and subject to boundary conditions 

u{t, x) = x) V(t, a;) G d*QR := ((0, T) x d.^R) U ({T} x .SSr) 

with 

• *(T,a;) = 1VxG^r; 

• "^(t,x) = ■>p{t,x)'i{t,x) G (0,r) X d^R, where -tjj is some function of class C^'^{Qr)- 

Define a sequence of functions u^, u^,... on Qr — [0,r] x I^r and of bounded measurable feedback 

control laws h'',... where /i° is an arbitrary control. solves the boundary value problem: 

+ hr (AA'(i, x)D^u''+^) + fait, X, h^)' Du^+^ + eg{t, x, h^)u''+^ + dl{t, x) = 

(4.40) 

and subject to boundary conditions 

u{t, x) = a;) V(t, a;) G d*QR ((0, T) x Si^j^) U ({T} x ^j^) 
Moreover, for almost all (t, a;) G Qr, fc = 1, 2, . . ., we define /i*^ by the prescription 

(4.41) h'' = Argmin;,g_7 {/^(t, a;, /i)'!??/*^ + ^(t, a;, /i)u''} 
so that 

/a(t, a;, h^)'Du^ + 6i5(t, a;, = mf {/a(t, x, /i)'!?^'^ + 6»g(i, x, h)u^] 

(4.42) =i/a(^,x,M^I?li*'■) 

Note that the boundary value problem (j4.40p is a special case of the generic problem introduced 
earlier in equation (I4.37P with 

a{t,x) ^ AA'{t,x) 
b{t,x) = fa{t,x,h^) 
c{t,x) = g{t,x,h'') 

d{t,x) = da{t,x) 

Moreover, since £§r is bounded and J is compact, all of these functions are also bounded. In particular 
< oo for any p > because $ is bounded and d* is a continuous function of $ by Lemma l49l 
Thus, based on standard results on parabolic Partial Differential Equations (see for example Appendix E 
in Fleming and Rishel [5] and Chapter IV in Ladyzenskaja, Solonnikov and Uralceva [Il|), the boundary 
value problem (j4.40p admits a unique solution in ^^{Qr) for any p > depending only on the properties 
of d and on the boundary conditions. Indeed, by estimate (E.8) in Appendix E of Fleming and Rishel 

(4.43) ^ (ii4(i,^)iip,Q. + ii*ii!,1qO 

for some constant Mj^ depending on R. The terms ||c?*(t, x) ||p^Q^ and ||^||p'^a,Q^ a-re finite which implies 
that llw'^llp^Q^ is finite. Thus the sequence {u^)ken is bounded. 

Moreover, if we pick p > the boundedness of ll'w'^llp^Q^ resulting from estimate (|4.43l) implies 

that the Holder norm 

fcia , \u^{t,x)-u^{t,y)\ 



W\q,= sup \u'{t,x)\+ sup 

{t,x)^Qa ix,y)eG 1^ 2/1 

0<t<T 

\u''{s,x) - u''{t,x)\ 



xeG I* I 

0<s,t<T 
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is bounded for some < a < 1, proving that is continuous on Qn (see Ladyzenskaja, Sofonnikov and 
Uralceva iMj), p. 89). Define the Holder norm I^'^Iq^ by 



For p > n + 2, we have the folfowing estimate (see equation (E.9) in Appendix E of Fleming and Rishel 

M) 

(4.44) \u%l<MMu'\\^;f)^^ 
for some constant M'^ (depending on R) and with 

, n + 2 

a = 1 

P 

The Holder norm |w''|q^ is finite and as a result Du^ is continuous on Qu- In particular, if we denote 
by "^^'"(Q), < a < 1 the Holder space of all functions -0 such that IV'Iq" is finite, then u'^ e ^^'"^{Qr)- 

Step 2: Convergence Inside the Cylinder (0,r) x [Mr 
Take fc > 1. By (g^S]), 

^ + itr {KK'{t,x)D^u^) + fa{t,x,h^)' Du^ + eg{t,x,h'')u^ + dt{t,x) 

< _ + _tr (AA'(t, x)D^u^) + /a(t, X, h^'^)' Du^ + 6l5(t, x, /i'^"!)?**^ + d*(t, x) 
= 

Subtracting (g^Hl), 

^-^)+^tr(AA'(M)i?^ [.'^^^ 

(4.45) +/a(i, X, h^y {Du^+^ - Du''+^) + eg{t, x, h'') {u''+^ - u'') < 

Define the sequence of functions {W'')keN as 
then ly*^ satisfies the inequality 

(4.46) + -tr (AA'(t, x)i:»2yyfe) ^_ /I'^^DM^'^ + 0g{t, x, /i'=)l^'= < 

in (0,T) X ^fl, and with boundary condition VF*=(T,x) = on d*QR = ((0,T) x 9^^) U ({T} x ^a). 
Moreover, W'' is continuous on Qi? by continuity of u'' Vfc £ N. By the Maximum Principle in Lemma l4.19l 
below, W'^{t,x) < for fc > 1 and hence by definition of W'', 

> u''+\ Vfc e N 

which implies that the sequence {u'^j^^j^ is non decreasing. As a a result, it is bounded from above 
by u^. Since the sequence (w'^)fcgN is non-increasing and is also bounded, it converges. Moreover the 
convergence is uniform because u'^ is uniformly continuous. Denote by u its limit as fc — > oo. 

For p > n + 2, Du^ is continuous and as fc oo we conclude that 

• Du^ converges to Du uniformly on Qr ; 

• D^u'', converge weakly in U'{Qr) respectively to D^u and 
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step 3: Proving that u G C''^^'^{Qr) 
Using relationship (I4.42p and then equation (|4.40p . we get: 

— + -tr (AA'(i, x)D'^u'') + fa{t, X, h)' Du'' + 0g{t, x, h)u^ + d*(t, x) 

cli / ^ 1 

> _ + _tr (AA'(i, x)D'^u^) + fa{t, X, h^)' Du^ + eg{t, x, h^)u^ + a;) 



+ Qtr [{KK'{t,x))D''u'') - {KK'{t,x)D''u''+^)] 



dt dt 

(4.47) +fa{t, X, h^y {Du^ - Du''+^) + eg{t, x, h^) {u^ - u^+^)] 

for any admissible control h. Since the left-hand side of (|4.47p tends weakly in L^[Qb) to 

(4.48) ^ + itr(AA'(t,x)I?2u) + fa{t,x,h)' Du + eg{t,x,h)u + dt{t,x) 

as — > GO and the right-hand side tends tends weakly to 0, then we obtain the following inequality 

+ -tr (AA'(t, x)D'^u) + fa{t, X, h)' Du + 9g(t, x, h)u + df{t, x) > 

almost everywhere in Q^. 

Using a measurable selection theorem and following an argument similar to that of Lemma VI. 6.1 of 
Fleming and Rishel [9], we see that there exists a Borel measurable function h* from (0, T) x into J 
such that. 

fa{t, X, h*)' Du + 9g{t, x, h*)u — rai^ {fa{t, x, h)' Du + 9g{t, x, h)u} 

holds for almost ah {t,x) e (0,T) x ^r. Then 
du^ 1 

— + -tr {AA'{t, x)D'^u^) + fa{t, X, h*)'Du^ + 0g{t, x, h*)u^ + df{t, x) 

c)i / ^ 1 

< — 4- -tr {KK'{t, x)D'^u^) + fa{t, x, h^)' Du^ + eg{t, x, h^)u'' + dfit, x) 
du^ ^ Q^^. [^AA' ^t,x)D'u') - {AA'{t,x)D'u'+')] 

(4.49) +fa{t, X, h^)' {Du'' - Dm^^+i) + 9g{t, x, h'') - Du''+^)] 
Since the left-hand side of (I4.49P tends weakly in L'P{Qfs) to 

+ -tr (AA'(i, x)D'^u) + fa{t, X, h*)' Du + eg{t, x, h*)u + d^it, x) 
as fc — )■ oo and the right-hand side tends weakly to 0, then we obtain the inequality 

(4.50) + -tr {AA'{t, x)D^u) + fait, x, h*yDu + 9g{t, x, h*)u + d^{t, x) < 
almost everywhere in Q^. 

Combining (|4.48p and (|4.50p . we have therefore shown that 

(4.51) + -tr (AA'(i, x)D^u) + fait, x, h*yDu + eg{t, x, h*)u + df{t, x) = 

almost everywhere in Q^. Hence, m is a solution of equation (|4.39p . Moreover, u £ J^^{Qr.) and as a 
result u G '^^'"{Qu.) for p > n + 2 by estimate (|4.44p . Also, since Ha is locally Lipschitz, \u\q^ < oo for 
a > and |£)w|q^ < oo for < a < 1, then \Ha{t,x,u, Du)\q^ < oo. 
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The key idea now is that we can rewrite PDE (|4.51|) as 
d 1 

(4.52) + -tr (AA'(t, xjD'^u) + Ha{t, x, u, Du) + df{t, x) ^ 

which only depends on t and x, but not expHcitly on h. Let H"(t, x) :— Ha{t, x, u, Du) and consider the 
auxihary PDE 

(4.53) + -tr (AA'(t, x)D'^v) + F{t, x) = Q 

where F{t, x) := H^{t, x) + (i*(t, a;), and subject to boundary conditions 

v{t, x) = x) V(t, x) e d*QR := ((0, T) x d.^R) U ({T} x j^r) 

It is clear that u solves both (j4.52l) and (j4.53p . Using similar arguments to those developed so far, we 
can show that auxiliary PDE (|4.53p admits a unique solution v, which coincides with u. 



To go further, we need to know that F is Holder continuous. However, is continuous by Lemma 
and Ha is locally Lipschitz by Remark 14.101 so we can use the argument proposed by Davis, Guo and 
Wu [5] in the proof of their Theorem 5.5 to show that F is Holder continuous in x with exponent 
< a < 1. We omit the details of the proof here as it is lengthy but solely requires standard calculus 
techniques. 



We can now show that u G C^'^{Qr)- Define 



dt 



2J = 1 



and denote by "^^'"(Q), < a < 1 the Holder space of all functions ip such that l^/^lg" is bounded. 

Now, consider two open subsets Q' and Q" of Q such that Q' C Q" . By estimate (ElO) in Appendix 
E of Fleming and Rishel ^ , we have 

(4.54) \v\%?<M^{\FrQ„ + \\v\\Q„) 

for some constant M2 depending solely on Q' and Q" . Set Q" = Qr and take Q' to be any subset of Q 
such that Q' CQ. Thus 

(4.55) = \vf^? < Ah + \\v\\q,) < 00 

When interpreted in light of estimate (|4.44p . we see that the derivatives ^ and " satisfy a 
uniform Holder condition on any compact subset Q' of Qr. By Theorem 10.1 in Chapter IV of Ladyzen- 
skaja, Solonnikov and Uralceva [T3|, we can therefore conclude that u £ C^''^{Qr)- 

Step 4: Convergence from the Cylinder (0, T) x .^r to the State Space (0, T) x M" 

For ^ = 1, 2, . . ., we define a function ai satisfying the following 

(i) . ai e 

(ii) . ai > 0; 

(iii) . 



ai {x) := 



1 for x e 

for a; e M"\^;+i 



{iv),|tf|<2. 

Let be a solution of the PDE: 

(4.56) -^ + -tT{AA'{t,x)D^ui)+ai{x)Hait,x,ui,Dui)+dfit,x)=0 
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and subject to terminal condition ui{T^x) — ai{x). 

_______ 

By the local estimate (|4.44p from step 1 above, is bounded for p > 1 for any bounded Q C 

(0, T) X R" and Wi satisfies a Holder condition on each bounded Q. In particular, take Q :— (0, T) x ^^i^ 
for some Iq > 0. For I > Iq, ui solves the "parabolic" PDE (j4.ip in Q. 

By Remark 14.101 Ha is locally Lipschitz continuous. Taking into account the estimate (j4.54p . we 
find, that and g^"^ also satisfy a uniform Holder condition on any compact subset of Q. 

By Ascoli's theorem, we can find a subsequence {u')^^^ of (u''*')^gpj such that 

• (M')jgpj tends to a limit u uniformly on each compact subset of Qq; 

• ( ^ I tends to a limit % uniformly on each compact subset of Qo; 
\ot J at 

• (-Du')jgj^ tends to a limit Du uniformly on each compact subset of Qo; 

• (D^M')jgj^ tends to a limit D'^u uniformly on each compact subset of Qo- 

To conclude, the function u is a classical solution of the equation (14. ip with terminal condition 
^{T,x) = 1. 
□ 

A parabolic version of the weak maximum principle is required in the previous proof to show that 
the sequence of function {u'')k=i,... converges!! The parabolic weak maximum principle used in the proof 
takes the form: 

Lemma 4.18 (Classical Weak Maximum Principle (Theorem 5.1 in Pham {20 )). Consider a parabolic 
PDE of the form (|4.37p with parabolic operator 

(4.57) LiP=^ + ^tr (a(t, x)D^^P) + h{t, x)' Di) + ec{t, x)^j + ^ 

and assume 

• Q is bounded; 

• the operator Lip is parabolic for every (x, t) S Q; 

• the coefficients a{t,x) , b{t,x), c{t,x) andd{t,x) are continuous; 

• c{t, x) < 0; 

• ^ is continuous on Q in the viscosity sense, 

• Lip > in Q, 

• V < on d*Q 
then ip <0 on Q. 

Proof. Refer to Pham [ID]- □ 

The condition c{x) < is proving too restrictive for our purpose. The following classical extension 
to the weak maximum principle partially addresses this difficulty: 

Lemma 4.19 (Extension of Theorem 14.181 for a bounded cost function c{x,t) (Theorem 5.1 in 
Pham HQj)). 

Consider a parabolic PDE of the form \4-37\ and assume 

• Q is bounded; 

• the operator L-tp is parabolic for every (x, t) G Q; 

• the coefficients a{t,x), b{t,x), c{t,x) and d{t,x) are continuous; 

• c(t, x) < cq, where cq > 0; 

• ip is continuous on Q in the viscosity sense, 

• Lip > in Q, 

• V < on d*Q 

then Ip < on Q. 

Proof. Introduce the function u{t, x) := e^'^°*ip{t, x). The second set of assumptions for the function 
Ip translates for u into: 

. u e C^-^{Q), 

• {L — co)u > in Q, 



■^Note that we do not need the maximum principle to show that <& > as this is a direct consequence of the structure 
of risk-sensitive control. 
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• u is continuous on Q, and 

• w < on d*Q 

Moreover the coefficient of u{t, x) in the paraboHc operator for u is now c{t, x) — cq < 0. Hence, we can 
apply Theorem 14. 181 to the function u in order to deduce that u < on Q and therefore -0 < on Q. 
□ 

Remark 4.20. The control-based argument used in the proof of Theorem 7.2 in 181 cannot he used 
here. The reason for this is that reinterpreting the PIDE as a PDE removes the natural connection between 
the PDE and the dynamics of the factor process. It therefore becomes more effective to consider the PDE 
in abstraction from the control problem and prove existence directly through standard PDE arguments. 

4.6. Existence of a Classical Solution to the HJB PIDE p.Sp . So far, we have shown that 
$ is a viscosity sohition to HJB PIDE p.Sp in Section 4.1 and that m is a classical solution of the equa- 
tion p.8p with terminal condition $(r, x) = 1 in Section 4.5. In this subsection, we prove that HJB 
PIDE p.8p admits a classical solution by showing that tt = <E>. 

Theorem 4.21 (Existence of a Classical Solution to the HJB PIDE (13. 8^ '). Under Assumvtion \2.10\ 
the RS HJB PIDE with terminal condition <b{T, x) ^ I has a unique solution $ g C^^^ ((0, T) x R") 

with $ continuous in [0,T] x R". 

Proof. We showed in Theorem 14. 4[ Proposition 14.131 and Theorem 14.141 that $ is both a Lipschitz 
continuous viscosity solution of HJB PIDE (|3.8p and the unique viscosity solution of HJB PDE (14. ip . 
Now, observe that a classical solution is also a viscosity solution. Broadly speaking the argument is that 
if the solution of the PDE is smooth, then we can use it as a test function in the definition of viscosity 
solutions. If we do this, we will recover the classical maximum principle and therefore prove that the 
solution of the PDE is a classical solution. Hence, the classical solution u to PDE (|4.1I) . whose existence 
was proved in Theorem 14. 171 is also a viscosity solution of PDE (14. ip . As a result, $ = u and we conclude 
that $ is C^'^ and satisfies PIDE p.8p in the classical sense. Uniqueness follows from Corollarv l4.16l □ 

Corollary 4.22 (Existence of a Classical Solution for the Risk-Sensitive Control Problem). The 
RS HJB PIDE (1231) with terminal condition ^{T,x) = has a unique solution $ G C^'^ ([Q^T] x R") 
with $ continuous in [0,T] x R". 

Proof. This follows from the basic relationship between $ and $, i.e. $ ~ cxp{— ^?$}. □ 

5. Identifying the Optimal Strategy. All that remains now is to show that the controls derived 
from the Hamiltonian-minimizing function h of Corollary 13.71 and from the maximiser h of Proposition 
13.61 correspond to the optimal policy. 

Lemma 5.1. The Hamiltonian-minimizing function h of Corollary \3.7\ and the maximiser h of 
Proposition\Kd[ correspond to the same control h*{t,Xt), that is: 

hit, Xt, i^$(t, Xt)) = Ht, Xu $(t, Xt), D^it, Xt)) =: h*{t, Xt) 



Proof. The Hamiltonian-minimizing function h of Corollary 13.71 and the maximiser h of Proposition 
13.61 are both unique. Moreover $ and <& are related through a monotone transformation. This proves that 
h{t,Xt,D^t,Xt)) = h{t,Xt,^t,Xt),D^{t,Xt)). D 

Remark 5.2. The control h* introduced in step 3 of the proof of Theorem \4-l'A ^■s control 
h*it,Xt). 

Proposition 5.3. The control h*{t,Xt) is admissible: h*{t,Xt) G A. 

Proof. The proof follows closely Proposition 4.3 in Davis and Lleo [8]. The class of admissible controls 
is presented in Definition 12.41 □ 

Remark 5.4. The argument used in 18] is based on a result by Memin llT^j . One could also derive a 
similar argument using the elegant results of 

Theorem 5.5. The control h* is optimal. In particular ^{t, x) — I(v,x,h*;t;T;9). 
Proof. Consider the Borel-measurable minimizing control h*{t,Xt) with associated measure P* and 
let X{s),s > t he the state process with initial data X{t) ~ x. 
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Define the process Z{s) := 9 g{u, X^, hl^)du and use the general Ito formula to calculate Z{s)^{s, X{s)). 
We find that 



4>(s,X,)e^= = + / D^'A{u,X{u))dW^ 



(5.1) 



+ J [^{u,X{u-)+^{u,X{u-),z))~^iu,X{u-))^N{du,dz). 



(The drift term is equal to zero since h* achieves the minimum in the HJB PIDE p.Sp .*) We claim that 
both stochastic integrals in (|5.ip are martingales. Indeed, under Assumption [H Theorem 1.19 of [12] 
implies that 



(5.2) 



E* 



\X{s)\^ds 



< oo. 



This is enough to show that the Brownian integral is a martingale, since is bounded and A is Lipschitz 
in X. For the Poisson random measure integral we have, since $ is Lipschitz (with constant K), 

a{u,X{u-),z) = \^{u,X{u-) +^{u,X{u-),z) - ^{u,X{u-))\ < K\^{u, X{u-), z)\, 

so, by Assumption (|2.1ip . 



Hence by ([5 



a^{u,X{u-),z)iy{dz) < 3c^{l + \X{u-)\^). 



E* / a {u,X{u ), z)i'{dz)du < oo, 
Jo Jz 

and this is a sufiicient condition for the stochastic integral to be a martingale (see [TH], (1.1.13)). Thus, 
from (|5.ip . 

I>(t,x) =E*[$(r,A(T))exp(Z(T))] 
= E* e.^ !T 9(s,x,,hi)ds 

= i{v,x,h*-t;T;e). 

This completes the proof. D 
As usual, we have an equivalent result for the logarithmically-transformed control problem. 

Corollary 5.6. h* defined above is optimal for the logarithmically-transformed problem, and 

^{t,x) = I{t,x,h*;e;T;v). 



Proof. This corollary follows from the relation between $ and <i> and from the fact that an admissible 
(optimal) strategy for the exponentially transformed problem is also admissible (optimal) for the risk- 
sensitive problem. □ 

6. Conclusion. In this article, we reformulated the risk-sensitive investment management problem 
to allow jumps in both factor levels and asset prices, stochastic volatility and investment constraints. 
Using a combination of viscosity solutions, change of notation, policy improvement argument and classi- 
cal results on parabolic PDEs, we showed that the Bellman PIDE associated with our control problem 
does admit a unique smooth C^'^ solution. Furthermore, we proved via a verification theorem that this 
solution and the candidate optimal control we identified solve the control problem. 



At first, this outcome may appear fortunate given the non-linear and non-local nature of the PDF 
involved. In fact, the argument used in the derivation only hinges on three techniques. First, the Lipshitz 
continuity of the value function provides us with the ability to rewrite the HJB PIDE as a PDF. Second, 
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viscosity solutions give us existence and uniqueness of a weak solution to both of these equations. A proof 
of existence by Fleming and Rishel based on a policy improvement originally due to Bellman completes 
the triptic by providing a smooth solution. 



The robustness of the approach presented in this article is a clear advantage. Further research is 
needed to determine both the extend of the jump-diffusion problems this approach can be used to solve 
and how much further it can be developed. 



Appendix A. Proof of Proposition [3751 
Step 1: 

Take an admissible control h £ •A.{T) and consider the auxiliary criterion J defined under the P-measure 
as 

J{v, X, k t, T; 6) = e-^^(*'^'^^^^^^'^) = E*., exp g{s, X„ x^i) 

where the Doleans exponential is defined in (|2.29p 
By propertv 12.51 a is bounded the constant R 

R:=c^^{e\\g\U{T-t)} 

is well defined and bounded. Let -q G R" be a directional vector with = f , and fc e M be a scalar. 
Define the operator Aa;F(s, x) as 



A,F(s, x) := - x + fcr/) - x)] 
k 



Hence, 



AxJ{v,x,h;t,T; 



1 

k 

— E/ T 

k ' 



(A.l) 



J{v, xi + kr], h; t, T; 9) — J{v, xi, h; t, T; 9) 
expje^ g{s,X2{s),h{s))ds^x''{t) 
expje / g{s,X^{s),h{s))ds\x^{t) 



1 



where Xi{s) solves the state equation (|2.35p with Xi{t) — xi and ^2(s) solves the state equation (|2.35p 
with X2{t) = X2 '■= Xi + krj 



Define 

V\ := exp 



/i(s)'E(s, X,{s))dWs - -9^ / /i(s)'EE'(s, X,{s))his)ds )■ , i = 1,2 



(A.2) 
and 



Vt := exp 1+ y y In [1 - G{t, z, h{s))j N{ds, dz) 

+ J {in (f - G(i, z, /i(s))) +G(i,z,/i(s))}i/(dz)di 



(A.3) 



Let P-p be the measure on defined via the Radon- Nikodym derivative 



(A.4) 



Vt Vt > 
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then (jA.l|) becomes 



-E 



t,X2 



cxpld g{s,X2{s),h{s))ds\V^ 



-E 



t.Xi 



exp|^^%(s,Xi(s),M^*))ds|pi 



where E^^ [•] denotes the expectation taken with respect to the measure P'^ and with initial conditions 
{t,x). 



Thus 



Aj{v,x,h;t,T) = ^E^,^ 



exp ^ / gis,X2{s),h{s))ds\V^ 



expj^^ g{s,Xiis),his))ds'^V^^ 
Let P2 be the measure on (fl,J^) defined via the Radon-Nikodym derivative 



'k 



(A.5) 
Then, 



:= vt yt>o 



exp < 6* / g{s,X2{s)^h{s))ds>—eyi])l9 I g{s, Xi{s), h{s))ds 



1 -p2 



expje^ 5(s,Xi(s),/i(s))ds| (vl ' 



(A.6) 
where 



A E 



t.X2 



exp 6* / g{s,X2{s),h{s))dsj—exp<^9 J g{s, Xi{s), h{s))ds 



exp 



g{s,Xi{s),h{s))ds\ (vl 



exp|-0 J hisy[Eis,Xiis))-Eis,X2is))]dW^ 



and VK^(s) is a P2-Brownian motion. 
Step 2 

We focus on term B in (jA.6[) . By (jA.ip . we have 



The exponential martingale V]"'^ satisfies the SDE 

dV^'^is 



I?i.2(s) 



= -0/i(s)'[E(s,Xi(s)) -S(s,X2(s))]dW^; 
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thus, 



= Y,{s)-Y2{s) 



with 



Yi{s) := -ej^ V^'\u)h{uyE{u,Xi{u))dW^ 



i = 1,2 



Now, 



EL 



By Cauchy-Schwartz, 



< 



(A.7) 



The term 



= exp|-4e^ /i(r)'[E(r,Xi(r))-E(r,X2(r))]dW2 

-20^ ^ /i(s)' [E(r, Xi(r)) - S(r, X2(r))] [I](r, X2(r)) - I](r, X2(r))]' /i(r)dr j 



2?3 := exp <^ -i0 / /i(r)' [S(r, Xi(r)) - E(r, X2(r))] dVF^ 



where 



-8e'£h{ry [E(r,Xi(r)) - E(r,X2(r))] [E(r,X2(r)) - ^{r,X2{r))]' h{r)dr^ 
Let P3 be the measure on J^) defined via the Radon-Nikodym derivative 
(A.8) 



dF3 
dP2 



:= Vi > 



then 











EL. 


exp< 




r h{r)' [E(r, Xi(r)) - E(r, X2{r))\ [E(r, X2(r)) - E(r, X2{r))]' h{r)dr 





(A.9) < K3 
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where ^ is the expectation with respect to the measure P3 . The last inequahty follows by boundedness 
of !](•) and the constant depends on the choice of control h. 



We now look at the second term on the right hand side of (jA.7[) . By Lipschitz continuity, 

{h{uy[T.{u,Xi{u)) - ^{u,X2{u))] [^{u,Xi{u)) - J:{u, X2{u))]' h{u)y 
< Ki\Xi{u) - X2{u)\^ 

for u € [t, s] and where the constant K4 > depends on h and the Lipschitz constant K^. 
Let Z{u) = Xi{u) — X2{u), then 

dZ{r) = f{r, Z[r)dr + A(r, Z{r))dW^^ + j £,[z, Z{r))N^{dr, dz) 

where 

f{r,Z{r)) = f{r,X^{r),h{r)) - f{r,X2{r),h{r)) 
A(r,Z(r)) =A(r,Xi(r))-A(r,X2(r)) 

Z{t)) = e (r, Xi(r- ), z) - ^ (r, XaCr^), z) 



By Ito, 

\Z{u)\'^ = \Z{t)\'^ + A I Z\r)f{r,Z{r))dr+4 I Z\r)A{r, Z{r))dWir) 



+6 J Z^{r)AA'{r,Z{r))dr 



+ {{Z{u-)+^{z,Z{u-)))^ - Z\u-)-AZ^{u-)-^{z,Z{u))}iy{dz)dr 



t Jz 



+ J {iZ{u-)+^iz,Z{u-))f-Z\u-)-AZ^{u-)-^{z,Z{u))}Nidz,dr) 



Taking the expectation under P2, 



El\Z{u)f^\Z(tt + 2El,^ 



Z\r)f{r, Z{r)) + 3 / Z^(r)AA'(r, Z{r))dr 



t JZ 



{{Z{u-) + ^(z, Z{u-))Y ~ Z*{u') - iZ^iu-) ■ ^{z, Z{u))} v{dz)dr 



Applying Assumption [T] ([1]) , ([n]), (jvj) and Assumption ([ix)) as well as Remark we finally obtain 
E^.JXiH - X2{ut = \xi -X2\'' + C4 E2,jXi(r) - XaWl^dr 

Co := 4(i4:f, + eXf^s: + if^Xo) + 6^1 + j KI{6 + + Kl)iy{dz) 



and 



By Gronwall's inequality, 



Kn := 



(1 + /i'7(t, 2)) -Izoiz) v{dz) 
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Thus, taking into consideration (jA.9l) . equation (jA.7[) becomes 

and we conclude that term B in (|A.6|) is Lipschitz continuous since 

B < Cb\xi - X2\ 

where Cb ■= K^Re^^^'^'^-^^ 



Step 3: Conclusion 

The Lipschitz continuity of term A in (jA.6p fohows from Theorem VI. 8.1 and Lemma IV. 7.1 in [TU]. Let 
Ca > be the Lipschitz constant for term A, then 
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exp < 6* / g{s^X2{s),h{s))ds>—eyipl6 I g{s, Xi{s), h{s))ds 



'k ''^^ 



exp 



g{s,X,is),his))ds\ (V, 



< Cx\x2 - Xi\ 

where Cx '■= Cb + Ca- This completes the proof. 
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